ISSUES& AN S WERS 



REL 2008-No. 046 




Piloting a 
searchable 
database 
of dropout 
prevention 
programs in nine 
low-income urban 
school districts in 
the Northeast and 
Islands Region 





Institute of 



NATIONAL CENTER for 

EDUCATION EVALUATION 
and REGIONAL ASSISTANCE 

Education Sciences 



U.S. Department of Education 





ISSUES ANSWERS 



REL 2008-No. 046 




NORTHEAST 
6? ISLANDS 



Regional Educational Laboratory 
At Education Development 
Center, Inc. 



Piloting a searchable database of 
dropout prevention programs in nine 
low-income urban school districts in 
the Northeast and Islands Region 



March 2008 



Prepared by 
Athi Myint-U 

Education Development Center, Inc. 
Lydia O'Donnell 

Education Development Center, Inc. 
David Osher 

American Institutes for Research 

Anthony Petrosino 
WestEd 

Ann Stueve 

Education Development Center, Inc. 







NATIONAL CENTER for 

EDUCATION EVALUATION 
and REGIONAL ASSISTANCE 



Institute of Education Sciences 
U.S. Department of Education 



NY 




: REL 

NORTHEAST 
6* ISLANDS 



Regional Educational Laboratory 
At Education Development 
Center, Inc. 



Issues & Answers is an ongoing series of reports from short-term Fast Response Projects conducted by the regional educa- 
tional laboratories on current education issues of importance at local, state, and regional levels. Fast Response Project topics 
change to reflect new issues, as identified through lab outreach and requests for assistance from policymakers and educa- 
tors at state and local levels and from communities, businesses, parents, families, and youth. All Issues & Answers reports 
meet Institute of Education Sciences standards for scientifically valid research. 

March 2008 

This report was prepared for the Institute of Education Sciences (IES) under Contract ED-06-CO-0025 by Regional Educa- 
tional Laboratory Northeast and Islands administered by Education Development Center, Inc. The content of the publica- 
tion does not necessarily reflect the views or policies of IES or the U.S. Department of Education nor does mention of trade 
names, commercial products, or organizations imply endorsement by the U.S. Government. 

This report is in the public domain. While permission to reprint this publication is not necessary, it should be cited as: 

Myint-U, A., O’Donnell, L., Osher, D., Petrosino, A., & Stueve, A. (2008). Piloting a searchable database of dropout preven- 
tion programs in nine low-income urban school districts in the Northeast and Islands Region (Issues & Answers Report, REL 
2008-No. 046). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Educa- 
tion Evaluation and Regional Assistance, Regional Educational Laboratory Northeast and Islands. Retrieved from http://ies. 
ed.gov/ncee/edlabs 

This report is available on the regional educational laboratory web site at http://ies.ed.gov/ncee/edlabs. 



Summary | 

Piloting a searchable database of 
dropout prevention programs in nine 
low-income urban school districts in 
the Northeast and Islands Region 



Despite evidence that some dropout pre- 
vention programs have positive effects, 
whether districts in the region are using 
such evidence-based programs has not 
been documented. This report details a 
pilot project to generate and share knowl- 
edge by building a searchable database of 
dropout programs and policies. 

To generate and share knowledge on dropout 
programs and policies, this report details a 
project to create a searchable database with 
information on target audiences, preven- 
tion strategies, age ranges, in-school and 
out-of-school staff involvement, and whether 
programs were reviewed by the What Works 
Clearinghouse. Based on the dropout preven- 
tion literature, the database identifies nine 
service goals (such as increase school attach- 
ment and decrease truancy) and 17 core strat- 
egies (such as community learning curricula 
and tutoring/extra classes) and maps these 
across schools, districts, and programs and 
policies. 

Despite evidence that some dropout preven- 
tion programs have positive effects, whether 
districts in the region are using such evidence- 
based programs has not been documented. 

The report records dropout prevention pro- 
grams and policies in nine mid-size cities with 
the Northeast and Islands Region’s highest 
dropout rates, largest minority student popu- 
lations, and most children living below the 
poverty line. Because data collection was 



limited to nine pilot sites, the main purpose of 
the study is to demonstrate the types of ques- 
tions that the database can answer, especially 
as more districts are added and tracked over 
time. 

Each of the nine districts is currently imple- 
menting at least nine dropout prevention 
programs and policies. All programs and 
policies in the database explicitly target 
dropout prevention, dropout reduction, or 
school completion or target subpopulations of 
students that the dropout prevention literature 
demonstrates to be at high risk of dropping 
out (for example, pregnant teens, students 
who are old for their grade, and students with 
emotional or behavioral challenges). 

Testing the searchable database with data from 
the pilot districts focused on two sets of data. 
The first is the characteristics of programs and 
policies implemented across districts: 

• The core strategies most frequently used 
are tutoring/extra classes (38 records), 
social and emotional learning curricula 
(37 records), and community collaboration 
(34 records). 

• Each of the nine service goals is targeted 
by at least 14 programs or policies across 
the pilot districts. The goals most com- 
monly targeted are to improve academic 
performance and to increase school 
attachment. 
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• Seven programs and policies target middle 
school youth only (grades 6-8), 51 target 
high school youth only (grades 9-12), 46 
target both middle school and high school 
youth, and 20 are not grade specific. 

• About 30 percent of the programs target 
students with academic needs, about 18 
percent target students who are chroni- 
cally absent or truant, and about 15 
percent target students with behavioral 
challenges. 

The second set of data concerns the char- 
acteristics of individual districts and sets 
of districts: 

• Each pilot district uses 13 or more core 
strategies, with 11 core strategies of the 17 
used by all nine districts. 

• In six pilot districts the greatest number of 
programs and policies targets improving 
academic performance. The other three 
districts have more programs and policies 
targeting increasing school attachment 
and decreasing truancy and providing 
support during transitions. 

• In four pilot districts the greatest number 
of programs and policies targets subsets of 
students designated as at-risk because they 
are members of particular segments of the 
school population, such as pregnant teens 
and English language learners. In two 
districts the greatest number of programs 
and policies targets individuals who have 
exhibited behaviors, such as failing grades, 
that put them at high risk of dropping out. 

When information from more districts is 
available, the database will be able to provide 
data on other questions as well. The report 
includes sample shells for tables on those data. 

The database also identifies whether a program 
or policy has been reviewed by the What Works 



Clearinghouse. Two of the programs reviewed 
by the What Works Clearinghouse are being 
implemented in the pilot districts, Talent 
Search (five districts) and Career Academies 
(eight). None of the districts is using the other 
10 programs reviewed by the What Works 
Clearinghouse, and none is using a What 
Works Clearinghouse-reviewed program that 
has mixed effects or no discernable effects. 

Several programs and policies being imple- 
mented by multiple districts have not been 
reviewed by the What Works Clearinghouse. 
Review of such programs and policies will 
be appropriate only if they meet eligibility 
criteria, which require substantial evaluation 
evidence. To date, such evidence is limited on 
most programs being used. Reflecting the lack 
of rigorous evaluation is that most informants 
could provide only anecdotal evidence of local 
success (not included in the database). 

The report makes three recommendations for 
better documenting progress toward evidence- 
based practices for keeping students in school: 

• Moving beyond nine sites in the pilot 
phase with an effort across regional educa- 
tional laboratories to expand the database 
to include dropout prevention strategies in 
districts across the country. 

• Developing and implementing a sampling 
plan to catalog dropout prevention pro- 
grams and policies in Puerto Rico, where 
large proportions of students are at high 
risk of dropping out. 

• Expanding the database in the initial pilot 
sites to monitor changes in dropout preven- 
tion programs and policies and adoption of 
evidence -based practices — and to include 

a greater diversity of districts within the 
region, especially larger cities where many 
students are at risk of dropping out. 

March 2008 
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Despite evidence 
that some dropout 
prevention 
programs have 
positive effects, 
whether districts 
in the region 
are using such 
evidence-based 
programs has not 
been documented. 
This report details 
a pilot project 
to generate and 
share knowledge 
by building 
a searchable 
database of 
dropout programs 
and policies. 



WHY THIS STUDY? 

Dropping out of school before graduation can hurt 
personal income, employment opportunities, lit- 
eracy, and health throughout a lifetime, and it can 



make exposure to and involvement in crime more 
likely. According to a 2004 U.S. Census report, 
high school dropouts were 3.5 times more likely 
than graduates to be arrested in their lifetime and 
earned $9,245 a year less on average (Alliance for 
Excellent Education, 2007). Individuals who have 
dropped out of school account for nearly half the 
heads of household on welfare and for nearly half 
the prison population (Schwartz, 1995). 

Students drop out of school for a variety of reasons. 
In a recent study by Civic Enterprises, 47 percent of 
high school dropouts cited a lack of connection to 
school as the reason for their dropping out (Bridge- 
land, Dilulio, & Morison, 2006). Also linked to 
dropping out are poor academic performance, low 
school attendance, mobility, parenthood, experi- 
ence with the juvenile justice system, low parental 
involvement, the need to care for a family member, 
emotional and behavioral challenges, poor learn- 
ing conditions, and limited instructional support 
(Bridgeland et al., 2006; Neils & Balfanz, 2006). 
Other studies find that dropout is often a long- 
term, cumulative process, with risk factors present 
as early as 6th grade predicting whether a student 
completes school (Balfanz & Herzog, 2006). Nation- 
wide, students living in families with incomes in 
the bottom 20 percent were about four times more 
likely to drop out of high school between 2003 and 
2004 than peers from families with incomes in the 
top 20 percent (Laird, DeBell, & Chapman, 2006). 

Several states in the Northeast and Islands Region 
have among the highest average freshman gradua- 
tion rates. But New York consistently ranks among 
the lowest, and only 60.9 percent of freshmen 
who started high school in fall 1999 are estimated 
to have graduated on time (Seastrom, Hoffman, 
Chapman, & Stillwell, 2005). 

Even in Connecticut, which has relatively high 
and improving graduation rates, getting a diploma 
remains challenging in districts that serve largely 
low-income minority families of color (State of 
Connecticut Commission on Children, 2006). 

And in districts such as Bridgeport, Hartford, and 
New Haven, where large proportions of students 
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are eligible for free or reduced-price lunch, the 
cumulative four-year dropout rates are 14-22 
percent, compared with the state average of 7 
percent (Connecticut State Department of Educa- 
tion, 2007b). In Massachusetts the annual dropout 
rate in 2005/06 for low-income students was 5.5 
percent, compared with 2.6 percent for non-low- 
income students (Massachusetts Department 
of Education, 2007b). By one estimate, African 
American students are up to 10 times more likely 
than White students to attend a high school with 
high dropout and low graduation rates (Balfanz & 
Legters, 2004). In many districts graduation rates 
are lowest among Hispanic students. 

Even among students who complete high school, 
minority students are often less likely than White 
students to graduate on time or to receive diplo- 
mas indicating successful completion of a rigorous 
course of study (Council of the City of New York, 
2005). In Massachusetts the annual dropout rate 
is 6.8 percent for African American students and 
7.9 percent for Hispanic students, compared with 
2.3 percent for White students (Massachusetts 
Department of Education, 2007b). Gender dispari- 
ties in education are also more pronounced among 
minority youth. An analysis of 2003 graduation 
data finds that although 59 percent of African 
American females earned a diploma, only 48 per- 
cent of males did so. Among Hispanic students, 

58 percent of females graduated but just 49 percent 
of males did so. Among White students, however, 
79 percent of females and 74 percent of males 
earned a diploma (Greene & Winters, 2006). 

Literature on dropout prevention shows that a 
number of strategies may help stop youth from 
dropping out (Dynarski & Glea- 
son, 2002; Hammond, Shrink, 

& Drew, 2007). The What Works 
Clearinghouse is conducting a 
rigorous review of how effectively 
dropout prevention programs 
help students stay in school, 
progress in school, and complete 
school (What Works Clearing- 
house, 2007a-h). 



Based on the dropout 
prevention literature, 
the database identifies 
nine service goals and 
17 core strategies and 
maps these across 
schools, districts, and 
programs and policies 



Dropout prevention can begin in the early grades, 
with literacy programs, for example. But students 
ages 15-17 are at greatest risk of dropping out, 
so this report follows the lead of the What Works 
Clearinghouse in focusing on middle school, 
junior high school, and high school, and on 
community-based interventions to help students 
stay in school and complete school. Among the 
programs that the What Works Clearinghouse has 
reviewed as having positive or potentially posi- 
tive effects are those that use close monitoring 
strategies, increase partnerships with families, 
establish career-focused academies in schools, 
and offer additional support for academic and 
behavioral success and college entry. The dropout 
prevention programs for which the What Works 
Clearinghouse has evaluated evidence use one 
or more specific strategies. Thus, the available 
evidence relates to the effectiveness of specific 
bundles of strategies that constitute programs and 
not, strictly speaking, to the individual strate- 
gies or to other programs incorporating different 
combinations of strategies. Dropout prevention 
initiatives may target individual students at high 
risk, defined groups of students, or whole schools 
and districts. 

Despite evidence that some programs can help 
students stay in school and progress, whether 
districts in the Northeast and Islands Region 
are using these evidence-based programs has 
not been documented. To generate and share 
knowledge on dropout programs and policies, 
this report details a project to create a searchable 
database with information on target audiences, 
prevention strategies, age ranges, in-school and 
out-of-school staff involvement, and whether pro- 
grams were reviewed by What Works Clearing- 
house. Based on the dropout prevention literature, 
the database identifies nine service goals and 17 
core strategies and maps these across schools, 
districts, and programs and policies. The project 
was in five parts: 

• Prepare an interactive, searchable database 
to catalog information on dropout prevention 
policies and programs. 
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• Develop and field test a protocol for systemati- 
cally collecting information about dropout 
prevention programs and policies in nine 
mid-size cities with the Northeast and Islands 
Region’s highest dropout rates, largest minor- 
ity student populations, and most children 
living below the poverty line. Because data 
collection was limited to nine pilot sites, the 
main purpose is to demonstrate the types of 
questions that the database can answer, espe- 
cially as more districts are added and tracked 
over time. 

• Pilot potential uses of the database for dis- 
playing information on programs and policies 
for dropout prevention. 

• Document whether these cities have imple- 
mented evidence-based programs and policies 
consistent with What Works Clearinghouse 
findings. 

• Make recommendations for documenting 
progress toward evidence-based practices in 
the selected cities and for expanding this ef- 
fort to additional districts (for example, large 
cities, urban fringe, small towns, and rural 
areas). 

Each of the nine districts is currently implement- 
ing at least nine dropout prevention programs and 
policies. Programs and policies were entered as a 
record when identified by key informants as a dis- 
tinct dropout prevention initiative in their district, 
usually with a specific name or title to identify 
them. Programs are typically funded by discrete 
grants or budget allocations, target a specific 
subgroup of students, and go beyond the standard 
student experience. Policies are typically dis- 
trictwide initiatives that aim to reduce dropouts, 
often targeting a wider and more universal group 
of students and not as dependent on discrete fund- 
ing. Both programs (such as Talent Search) and 
policies (such as one that allows freshmen who 
do not have enough credits to continue into 10th 
grade while taking accelerated freshman credits) 
were entered into the database. 



All programs and policies 
in the database explicitly 
target dropout preven- 
tion, dropout reduction, 
or school completion or 
target subpopulations of 
students that the drop- 
out prevention literature 
demonstrates to be at 
higher risk of drop- 
ping out (for example, 
pregnant teens, students 
who are old for their 

grade, and students with emotional or behav- 
ioral challenges). Staff also identified programs 
or policies through a search of publicly available 
information. 



Illustrative analyses 
using the pilot data 
present two types 
of tabulations: 
characteristics of 
programs and policies 
implemented across 
pilot districts and 
characteristics of 
individual districts or 
groups of districts 



Illustrative analyses using the pilot data present 
two types of tabulations. The first examines the 
characteristics of programs and policies imple- 
mented across the nine pilot districts: 

• The core strategies most frequently used are 
tutoring/extra classes (38 records), social and 
emotional learning curricula (37 records), and 
community collaboration (34 records). 

• Each of the nine service goals (improve 
academic progress and address behavioral 
challenges, for example) is targeted by at 
least 14 programs or policies across the pilot 
districts. The goals most commonly targeted 
are to improve academic performance and to 
increase school attachment. 



• Seven programs and policies target middle 
school youth only (grades 6-8), 51 target high 
school youth only (grades 9-12), 46 target 
both middle school and high school youth, 
and 20 are not grade specific. 

• About 30 percent of the programs target stu- 
dents with academic needs, about 18 percent 
target students who are chronically absent or 
truant, and about 15 percent target students 
with behavioral challenges. 
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The second set of illustrative tabulations examines 
the characteristics of individual districts or groups 
of districts with a common characteristic: 



The report makes three recommendations for bet- 
ter documenting progress toward evidence-based 
practices for keeping students in school: 



• Each pilot district uses 13 or more core strate- 
gies, with 11 core strategies of the 17 used by 
all nine districts. 



• In six pilot districts the greatest number of 
programs and policies targets improving aca- 
demic performance. The other three districts 
have more programs and policies targeting 
increasing school attachment, decreas- 
ing truancy, and providing support during 
transitions. 



• In four pilot districts the greatest number 
of programs and policies targets subsets of 
students designated as at risk because they 
are members of particular segments of the 
school population, such as pregnant teens and 
English language learners. In two districts 
the greatest number of programs and policies 
targets individuals who have exhibited behav- 
iors, such as failing grades, that put them at 
high risk of dropping out. 



The project created a 
searchable database 
with information on 
target audiences, 
prevention strategies, 
age ranges, in-school 
and out-of-school 
staff involvement, and 
whether programs were 
reviewed by the What 
Works Clearinghouse 



As of June 2007 two of the programs reviewed by 
the What Works Clearinghouse are being imple- 
mented in the pilot districts, Talent Search (in five 
districts) and Career Academies (in eight). None 
of the districts is using the other 10 programs 
reviewed by the What Works Clearinghouse, 

and none is using a What Works 
Clearinghouse-reviewed program 
that has mixed effects or no dis- 
cernable effects. Several programs 
and policies being implemented 
by multiple districts have not 
been reviewed by the What Works 
Clearinghouse. Review will be ap- 
propriate only if they meet eligibil- 
ity criteria, which require substan- 
tial evaluation evidence. To date, 
such evidence is limited on most 
programs being used. 



• Initiating an effort across regional educational 
laboratories to expand the database to include 
dropout prevention strategies in districts 
across the country. 

• Developing and implementing a sampling 
plan to catalog dropout prevention programs 
and policies in Puerto Rico, where large 
proportions of students are at high risk of 
dropping out. 

• Expanding the database to monitor changes 
in dropout prevention programs and policies 
and adoption of evidence-based practices in 
the initial pilot sites — and to include a greater 
diversity of districts within the region, espe- 
cially larger cities where many students are at 
risk of dropping out. 



PRODUCING THE SEARCHABLE DATABASE 

To generate and share knowledge on dropout pro- 
grams and policies, the project created a search- 
able database with information on target audi- 
ences, prevention strategies, age ranges, in-school 
and out-of-school staff involvement, and whether 
programs were reviewed by the What Works 
Clearinghouse. The purpose of the database, which 
will be made publicly available on request, is to 
increase communication and collaboration across 
states and districts on strategies used and lessons 
learned. For this report, the database includes 
data for nine pilot districts. The hope is that over 
the long term the database will become a cumula- 
tive inventory of dropout prevention programs 
and policies in the Northeast and Islands Region 
and perhaps nationwide. Information can be 
readily updated, new districts can be added, and 
programs that are no longer being implemented 
can be stored, along with information about their 
active dates. 
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The searchable database is divided into four types • Increase school attachment, 

of pages, each linked to the others (see appendix A 

for details): • Provide support during transitions. 



• Program and policy details, which can be 
used to find a range of information about a 
specific dropout prevention program or policy. 

• District details, which can be used to view 
information about each district, including 
the proportion of students eligible for free 
or reduced-price lunch, the ethnic composi- 
tion of the student body, and the most recent 
dropout rates. 

• School details, which capture location, school 
type, and program information for each 
school in the database. 



PREPARING THE DATABASE IN PILOT DISTRICTS 

The project collected data using many strategies, 
including a review of publicly available informa- 
tion and telephone interviews with key informants 
in districts, schools, and programs. That informa- 
tion was used iteratively to identify categories per- 
tinent to cataloging dropout prevention programs. 
Staff then used the searchable database to compile 
information from a pilot sample of mid-size cities, 
refining the categories as additional data were 
gathered. Information was then coded and entered 
into the database. 



• Prevention programs list, which is a sortable 
list that includes the name of each program or 
policy in the database and the corresponding 
districts. Users can sort by program name or 
district, and a hyperlink will take them to the 
corresponding program or policy page. 

School and district pages link to programs and 
policies implemented there. Information on 
programs and policies includes identifying them 
using a standardized list of prevention strategies 
and service goals. Dropout prevention strate- 
gies are in table 1. Nine service goals to address 
decreasing dropout were identified: 

• Improve academic performance. 

• Address behavioral challenges. 

• Provide career planning and preparation. 

• Promote college planning and linkages. 

• Provide mental health support. 

• Decrease truancy. 

• Address school safety and environment. 



The project sought districts for which staff would 
be able to collect comprehensive information 
on programs and policies implemented within 
the whole district, rather than just in individual 
schools, during the project period. Thus, the larg- 
est districts in the region (Boston, Buffalo, New 
York, and San Juan) were excluded for the initial 
field test. A list of mid-size cities in each state was 
compiled, with mid-size city defined by the Census 
Bureau of the U.S. Department of Commerce as a 
“central city of a metro area, with the city having a 
population under 250,000.” 



Statistics on each city’s 
non-White student popu- 
lation (Hispanic/Latino 
for ethnicity and African 
American, not Hispanic 
or Latino, for race), 
children living below the 
poverty line, and drop- 
out rates were reviewed. 

The nine selected sites 

are mid-size urban districts with the highest 
percentage of non-White students, students 
living below the poverty line, and cumulative 
four-year dropout rates. Methods of calculation 
for the cumulative four-year dropout rates and 



The nine selected sites 
are mid-size urban 
districts with the highest 
percentage of non-White 
students, students living 
below the poverty line, 
and cumulative four- 
year dropout rates 
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TABLE 1 

Core dropout prevention strategies 



Core strategy What the strategy does 



Accelerated credit accumulation 


Provides students with opportunities to fulfill credits in an expedited 
way so that they can catch up with their same-age peers. 


Advocating for student needs 


Encourages program staff to communicate with school officials or key 
personnel about students' needs and ways to address them. 


Career education and 
workforce readiness 


Introduces and exposes students to different types of careers 
and provides skills for entering the workforce. 


Case management/ 
service coordination 


Provides students or families who require multiple services 
with coordinated care throughout service delivery. 


Community collaboration 


Works with various community agencies and individuals to increase 
school-community collaboration and to link students to services. 


Engaging and supporting families 


Involves parents, guardians, and other family members in program activities and 
provides support to families to help them address issues that may facilitate dropout. 


Individualized or culturally/ 
linguistically relevant instruction 


Customizes instruction to match students' needs and abilities and recognizes 
and incorporates the cultural and linguistic diversity of students. 


Instructional technologies 


Uses innovative new technologies, such as teacher-supported 
computer-based learning, to increase student motivation. 


Mentoring 


Matches students with adult mentors in an effort to establish 
a close and supportive one-on-one relationship. 


Monitoring attendance 


Uses tools or strategies to help schools more closely monitor whether or not a 
student is in school and to contact parents to let them know that their child is absent. 


Out-of-school enrichment 


Provides students with after-school, Saturday, and summer enrichment programs. 


Professional development 


Provides opportunities for teaching staff to gain skills they can use inside and 
outside the classroom to enrich their experiences and those of their students. 


Providing social and emotional 
support during transitions 


Focuses on providing support to students who are in transition periods — going from 
middle to high school, pregnancy, returning from incarceration, newly immigrated, 
and parenthood; includes providing support to students with mental health needs. 


Social and emotional learning curricula 


Uses curricula in classrooms to help students develop social and 
emotional learning skills (for example, conflict resolution) to deal with 
circumstances that may place them at risk of dropping out. 


Systemic/policy renewal 


Focuses on creating a formal process to create or update coordinated district-level 
policies for dropout prevention to address the most current issues and risks. 


Transforming the school environment 


Strives to create an overall school environment that is caring, safe, and 
emotionally supportive and in which students feel safe and a sense 
of respect and self-worth; may include smaller communities. 


Tutoring/extra classes 


Provides students with extra academic support for subjects 
in which they are failing or not excelling. 



Source: Authors' review of the literature as described in appendix A. 

the annual rates may, however, vary across states. a cohort who were enrolled in 9th grade but did 

Annual dropout rates reflect the percentage of not graduate four years later. Each site had a non 

students enrolled in a school year (often includ- White population of at least 23 percent, at least 

ing the previous summer) who did not return by 21 percent of children living below the poverty 

the following October and who had not trans- line, and four-year dropout rates of at least 15 

ferred to a different school. The four-year cumu- percent (see box 1 and appendix A for details on 

lative rate reflects the percentage of students in methodology). 
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BOX 1 

Collecting data for the database 

A protocol was developed for compiling information 
about dropout prevention programs and policies from 
many sources: publicly available documents on district 
and school initiatives, information on evidence-based 
programs identified by the What Works Clearinghouse 
and other dropout prevention resources, and interviews 
with key informants. Supporting materials, such as 
introductory letters to school superintendents, interview 
guides, and templates for the initial recording of infor- 
mation were developed (see appendixes B and C). The 
protocol was then field tested in each of the nine selected 
districts and refined as needed. 

If asked by key informants to define dropout, project staff 
referred to the definition of “event dropout rate” (often 
referred to as an “annual dropout rate”) as defined by the 
National Center for Education Statistics: “students who 
left school between the beginning of one school year and 
the beginning of the next without earning a high school 
diploma or its equivalent (for example, a GED).” The large 
majority of informants did not ask for a definition of 

Taken together, the selected school districts serve 
more than 200,000 students in more than 400 
schools. Annual dropout rates range from about 
4 percent to 10 percent, and cumulative four-year 
dropout rates range from 15 percent to 34 per- 
cent. Three states (Maine, New Hampshire, and 
Vermont) and the Virgin Islands did not have mid- 
size cities that met study criteria (high dropout 
rates and minority student populations and many 
children living under the poverty line). Their pro- 
grams and policies can be cataloged in later years 
using the protocol and searchable database. 



PILOTING THE DATABASE WITH DATA 
FROM THE NINE DISTRICTS 

This section shows how the searchable database 
can be used. Because data collection was limited 
to nine pilot sites, the main purpose is to demon- 
strate the types of questions that the database can 



Key informants interviewed 



1 Level 


Position 


Number 




Superintendents 


3 




School board chairs 


1 




Dropout coordinators or specialists 


3 




Assistant superintendents 
Directors/coordinators 


2 




of pupil services 


7 


District 


Department supervisors 


4 




Principals 


4 




Assistant principals 


1 


School 


Counselors 


2 




Program directors 


19 




Program coordinators 


5 


Program 


Advisors 


6 



dropout. All project data, including written notes, audio 
cassettes, and supplemental materials, were archived. 

Across the nine districts 58 representatives participated 
in project interviews. These informants held key positions 
in districts, schools, and programs (see table). An average 
of six key informants participated for each district, and at 
least four individuals participated in all but one district. 

answer, especially as more districts are added and 
tracked over time. 

The database contains 124 records of dropout 
prevention policies and programs. One record, 
for example, describes a new policy in Lowell 
that allows 9th grade repeaters (“provisional 
sophomores”) to move with their classmates into 
the building for grades 10-12, so that they can 
continue to interact with same-age peers but also 
take make-up classes to earn the credits they 
need. Another record describes the program Gear 
Up, which is used by many districts, including 
Lowell, New Bedford, New Haven, Providence, and 
Syracuse. The program targets 7th and 8th graders 
and promotes early college planning and linkages 
through workshops and field trips. 

Each of the nine districts is currently implement- 
ing nine or more dropout prevention programs 
and policies. All programs and policies in the 
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database explicitly state dropout prevention, 
dropout reduction, or school completion as a goal 
or target subpopulations of students that dropout 
prevention literature demonstrates to be at higher 
risk of dropping out (for example, pregnant teens, 
students who are old for their grade, and students 
with emotional or behavioral challenges) (Neils & 
Balfanz, 2006; Rumberger, 2001; Osher, Morrison, 
& Bailey, 2003.). 

Testing the searchable database with data from 
the pilot districts focused on answering two sets of 
questions. The first set was about the characteris- 
tics of programs and policies implemented across 
districts. What core strategies are being used? Do 
they target all students (a universal intervention- 
level approach), subgroups at higher risk (selected 
approach), or individuals with characteristics 
that put them at higher risk (indicated approach)? 
What are the stated goals of different efforts? What 
subsets of student populations are targeted? 



The second set concerned characteristics of 
individual districts and subsets of districts. Do 
districts differ in the core strategies most com- 
monly used, or in the service goals most com- 
monly targeted? Does program selection vary by 
such district characteristics as the predominant 
race or ethnicity of students? Does selection vary 
by the proportion of students eligible for free or 
reduced-price lunch? 

The database might also be used to address other 
questions, especially as more districts are added 
and tracked over time. How many students are 
reached by programs at different intervention 
levels? How do the types of programs imple- 
mented by a district change over time? Do 
program and policy characteristics (for example, 
the intervention level) differ by the type of dis- 
trict (for example, whether districts are in large, 
mid-size, or small cities or in urban, suburban, 
or rural areas). 



TABLE 2 

Core dropout prevention strategies of programs and policies in the nine pilot districts 



Programs in database using the strategy 


Core strategy 


Number 


Percent 


Tutoring/extra classes 


38 


31 


Social and emotional learning curricula 


37 


30 


Community collaboration 


34 


27 


Engaging and supporting families 


29 


23 


Individualized or culturally/linguistically relevant instruction 


28 


23 


Transforming the school environment 


28 


23 


Providing social and emotional support during transitions 


26 


21 


Career education and workforce readiness 


26 


21 


Case management/service coordination 


25 


20 


Out-of-school enhancement 


22 


18 


Accelerated credit accumulation 


20 


16 


Monitoring attendance 


18 


15 


Professional development 


16 


13 


Mentoring 


15 


12 


Advocating for student needs 


13 


10 


Instructional technologies 


11 


9 


Systemic/policy renewal 


6 


5 



Note: Each program can apply more than one strategy. 

Source: Authors' analysis based on data described in appendix A. 
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How the database can answer questions about 
programs and policies across districts 

The database can be used to search for the number 
of programs across districts that meet a criterion. 
Consider, for example, the results of a search of 
programs and policies by core strategy (table 2). 
The core strategies most frequently used are tutor- 
ing/extra classes (38 records), social and emotional 
learning curricula (37 records), and community 
collaboration (34 records). Each strategy is cited by 
six or more programs and policies. Because a sin- 
gle program or policy may use multiple strategies, 
all strategies applying to a program are counted. 
Providence’s Ninth Grade Academy of Science, for 
example, which provides a structured environ- 
ment for youth at risk of dropping out, uses four 
core strategies: accelerated credit accumulation, 
community collaboration, out-of-school enhance- 
ment, and social and emotional learning curricula. 

Each of the nine service goals is targeted by at least 
14 programs or policies across the pilot districts 
(table 3). The goals most commonly targeted are 
to improve academic performance and to increase 
school attachment. Again, programs or policies 
may have more than one service goal, all with the 
outcome of decreasing dropout rates. The Transi- 
tions program at Rochester’s Young Mothers and 



Interim Health Academy, for example, seeks to 
provide support during transitions and to provide 
mental health support. 

A search by intervention level yields 30 programs 
or policies using a universal intervention ap- 
proach, 51 using a selected approach, and 43 using 
an indicated approach across the pilot districts. 

The database can be used to find out what grades 
the dropout programs and policies target. In the 
nine pilot districts 7 programs and policies target 
middle school youth only (grades 6-8), 51 target 
high school youth only (grades 9-12), 46 target 
both middle school and high school youth, and 20 
are not grade specific. The Southwest Mentoring 
Initiative for Learning, Education, and Services 
mentoring program in New Bedford, for example, 
targets middle school students. But as youth move 
into high school, they and their mentors may stay 
in the mentoring program, so this program is 
coded as targeting grades 7-12. 

Several programs and policies in the pilot districts 
target students as they transition into grade 9 or 
during grade 9, when many students drop out or 
fall behind in accumulating credits — as one inter- 
viewee notes, “if students make it to grade 10, they 
are more likely to make it to graduation” (personal 



TABLE 3 

Service goals of programs and policies in the nine pilot districts 



Service goal 


Programs in database with this service goal 


Number 


Percent 


Improve academic performance 


57 


46 


Increase school attachment 


38 


31 


Decrease truancy 


36 


29 


Provide support during transitions 


34 


27 


Promote college planning and linkages 


27 


22 


Provide career planning and preparation 


25 


20 


Address behavioral challenges 


23 


19 


Provide mental health support 


17 


14 


Address school safety and environment 


14 


11 



Note: Each program can apply more than one service goal. 
Source: Authors' analysis based on data described in appendix A. 
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TABLE 4 

Core strategies used by programs targeting 9th graders 



Programs using core strategy 


Core strategy 


Number 


Percent 


Social and emotional learning curricula 


27 


22 


Community collaboration 


25 


20 


Engaging and supporting families 


25 


20 


Tutoring/extra classes 


24 


19 


Transforming the school environment 


22 


18 


Providing social and emotional support during transitions 


20 


16 


Career education and workforce readiness 


18 


15 


Case management/service coordination 


18 


15 


Out-of-school enhancement 


17 


14 


Individualized or culturally/linguistically relevant instruction 


16 


13 


Monitoring attendance 


14 


11 


Professional development 


14 


11 


Mentoring 


12 


10 


Advocating for student needs 


10 


8 


Accelerated credit accumulation 


8 


6 


Systemic/policy renewal 


6 


4 


Instructional technologies 


5 


4 



Source: Authors' analysis based on data described in appendix A. 



communication with key informant, 2007). The 
database can show what the pilot districts are 
doing to keep students in school during this 
transition (table 4). To do this, users can search 
the database to find programs or policies using 
two criteria: grade level and core strategy. Lowell’s 
Freshman Academy, which was opened in fall 
2005, has 9th graders attend school in a separate 
building from upperclassmen and divides them 
into small clusters taught by a team of teachers. 
This program uses as core strategies individual- 
ized or culturally/linguistically relevant instruc- 
tion, social and emotional transition support, and 
systemic/policy renewal. 

The searchable database can also be used to better 
understand what core strategies are being imple- 
mented with other subsets of the student popula- 
tion. Across the pilot districts, for example, about 
30 percent of the programs target students with 
academic needs, 18 percent target students who 
are chronically absent or truant, and 15 percent 



target students with behavioral challenges (table 
not shown). Many programs and policies also have 
eligibility criteria or target students with charac- 
teristics that cut across specific (but often related) 
population subgroups. For example, two -thirds of 
the students participating in Talent Search must 
be from low-income families and must be the 
first generation in their family who would attend 
college. A sample shell shows how the database 
can be used with data from a greater number of 
districts to address how core strategies vary across 
programs and policies targeting different student 
populations (table 5). 



How the database can answer questions 
about districts and subsets of districts 

The database can be used to categorize and sum- 
marize records for individual districts or subsets 
of districts. These queries will become more valu- 
able as more districts are added to the database 
and as changes are tracked over time. 
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TABLE 5 

Sample table shell for displaying data to address how core strategies vary across programs and policies 
targeting specific populations 





Academic 


Behavioral 


Learning 


Mental health 


Chronically 


Core strategy 


needs 


challenges 


disabilities 


needs 


truant/absent 



Accelerated credit 
accumulation 



Advocating for student needs 

Career education and 
workforce readiness 

Case management/ 
service coordination 

Community collaboration 

Note: Users can choose what core strategies or student populations to include in their query. This table gives one example of how information can be displayed. 
Source: Authors' analysis based on data described in appendix A. 



The database can identify which core strategies are 
being used in specific districts. Each pilot district 
uses 13 or more core strategies, with 11 core strate- 
gies of the 17 used by all nine districts. In one 
district there are no records that indicate the core 
strategy of social and emotional support during 
transitions. Two districts do not have records not- 
ing instructional technologies or individualized 
or culturally/linguistically relevant instruction, 
and three pilot districts do not have records for 
monitoring attendance or advocating for student 
needs. This absence does not mean that there 
are no systematic efforts to monitor attendance 
or to advocate for students, but rather that these 
local efforts may not be viewed or categorized as 
dropout prevention. Systemic/policy renewal is not 
a core strategy in five districts. 

Another use is to search for the most commonly tar- 
geted service goals. In six pilot districts the greatest 
number of programs and policies targets improving 
academic performance. The other three districts 
have more programs and policies targeting increas- 
ing school attachment, decreasing truancy, and 
providing support during transitions. Seven districts 
have at least one program or policy targeting each 
of the nine service goals. Two districts target seven 
of the nine; school safety and environment is not a 
specified goal in either district. Again, it is possible 
that programs and policies not categorized as drop- 
out prevention address these goals in those districts. 



The database can be used to show variations 
in how districts address dropout. In four pilot 
districts the greatest number of programs and 
policies targets subsets of students designated as at 
risk because they are members of particular seg- 
ments of the school population, such as pregnant 
teens and English language learners (a selected 
intervention). In two districts the greatest number 
of programs and policies targets individuals who 
have exhibited behaviors, such as failing grades, 
that put them at high risk for dropout (an indi- 
cated intervention). 

Or consider another possibility: sorting districts 
by the racial/ethnic composition of their student 
population to see whether core strategies differ. In 
the nine pilot districts African American students 
are the largest racial group in three districts, 

White students in three, and Hispanic students 
in three. The most frequently used core strategies 
can be obtained by searching the core strategies 
in each type of district using the database and 
manually ranking the strategies by the number of 
programs using them (table 6). 

The database can be used to examine how service 
goals vary by district student population— say, the 
share of students eligible for free or reduced-price 
lunch (table 7). Because all nine pilot districts have 
more than half their students eligible for free or 
reduced-price lunch, districts are broken down 
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TABLE 6 

The top five core strategies in the pilot districts, by the predominant race/ethnicity of the district student 
body (rank order) 



Predominant race/ethnicity of student population 


1 Core strategy 


African American 


White 


Hispanic 


Case management/ 
service coordination 




3 


4 


Community collaboration 


2 




1 


Engaging and supporting families 


4 






Individualized or culturally/ 
linguistically relevant instruction 




1 




Monitoring attendance 


5 






Providing social and emotional 
support during transitions 




2 




Social and emotional learning curricula 


1 


3 


4 


Transforming the school environment 






2 


Tutoring/extra classes 


2 


3 


2 



Note: Duplicate numbers indicate a tie in the number of programs using the strategy. The predominant race/ethnicity is the race/ethnicity represented by 
the highest percentage of students in a district. 

Source: Authors' analysis based on data described in appendix A. 



TABLE 7 

Service goals in the pilot districts, by share of district student population eligible for free or reduced-price 
lunch (rank order) 



Service goal 


Districts with more than 75% of students 
eligible for free or reduced-price lunch 


Districts with 50%-75% of students 
eligible for free or reduced-price lunch 


Address behavioral challenges 


6 


5 


Address school safety and environment 


9 


9 


Decrease truancy 


5 


4 


Improve academic performance 


1 


1 


Increase school attachment 


3 


2 


Promote college planning and linkages 


2 


6 


Provide career planning and preparation 


3 


7 


Provide mental health support 


8 


8 


Provide support during transitions 


6 


2 



Note: Duplicate numbers indicate a tie in the number of programs using these strategies. 
Source: Authors' analysis based on data described in appendix A. 



into only two categories (50-75 percent of students 
eligible and over 75 percent of students eligible). 
More categories can be added as the database is 
expanded to accommodate the greater diversity 
of student populations across districts. As before, 
the most-cited service goals were obtained by 
searching districts within each income category 



and manually ranking goals by the number of 
programs targeting each. 

The database contains information on when pro- 
grams and policies were put in place and when they 
ended, making it possible to identify new initia- 
tives and ongoing or longer term ones — important 
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because many districts are developing more 
coordinated and systematic dropout prevention 
programs and policies and because keeping the 
database up-to-date will be essential for maintain- 
ing it as a useful resource. In Springfield Central 
High School the Ninth Grade Academic Pilot Team, 
which assigns 125 9th grade students into smaller 
teams with four core teachers, was launched dur- 
ing the 2006/07 school year. The Polly T. McCabe 
Transitional School, an alternative high school that 
provides a smaller learning environment and addi- 
tional support for pregnant teens and teen mothers 
in New Haven, was founded in 1960. 

The database will continue to change over time, as is 
evident in the many new programs developed in re- 
cent years. New Bedford recently created a Dropout 
Prevention Office, hiring two dropout prevention 
specialists for the district, creating an official dis- 
trictwide flowchart (referred to as the “algorithm”) 
for school staff to use when a student is considering 
dropping out, and forming an Alternative Educa- 
tion Task Force to gather communitywide input on 
developing the best alternatives for students at risk 
of dropping out. Rochester has several new dropout 
initiatives for 2007/08, including more funding for 
alternative programs and a partnership to allow for- 
mer dropouts to take courses for their high school 
diploma at a local community college. And several 
of the pilot districts have received funding over 



the past four years to implement Smaller Learn- 
ing Communities in their schools, often through 
creating new Career Academies, a What Works 
Clearinghouse-reviewed program. 

When information from more districts is avail- 
able, the database will be able to provide data on 
other sorts of questions as well. Table 8 shows how 
the database can rank district programs and poli- 
cies by the number of students participating and 
the intervention level. 

This type of information is useful because data 
from the pilot districts indicate that the number 
of students reached by each program or policy is 
highly variable. Some intensive or pilot programs 
are implemented with few students (44 students 
are in Syracuse Choice, for example). Career 
Academies, however, is a whole-school program 
implemented in eight districts, reaching more 
than 5,000 students in Rochester alone. The Adult 
Diploma Evening Program and Credit Recovery 
Program in Providence, which allow seniors or 
dropouts to recover credits needed for graduation, 
serve about 430 students during the year. 

Another possible use of the database is to exam- 
ine how the balance of universal, indicated, and 
selected programs within a given district changes 
over time (table 9). 



TABLE 8 

Sample table shell for displaying data on the number of students reached, by program or intervention level 
and policy 



Program or policy level 


District A 


District B 


District C 


District D 


District E 


Universal 


Program 1 












Program 2 












Selected 


Program 3 












Program 4 












Indicated 


Program 5 












Program 6 













Source: Authors' analysis based on data described in appendix A. 
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TABLE 9 

Sample table shell for displaying data on students in a district reached by policies and programs, by 
intervention level overtime 



Program or policy level 


2007/08 


2008/09 


2009/10 


2010/11 


2011/12 


Universal 


Program 1 












Program 2 












Selected 


Program 3 












Program 4 












Indicated 


Program 5 












Program 6 













Source: Authors' analysis based on data described in appendix A. 



TABLE 10 

Sample table shell for displaying data on number of students reached in cities, by intervention level and size 
of district 



Program or policy level 


Large cities 


Mid-size cities 


Small cities 


Universal 


Program 1 








Program 2 








Selected 


Program 3 








Program 4 








Indicated 


Program 5 








Program 6 









Source: Authors' analysis based on data described in appendix A. 



The database can also show whether program 
choice differs by district characteristics. In table 10 
the results would be limited to urban districts and 
sorted by size. 



USING THE DATABASE TO IDENTIFY WHAT 
WORKS CLEARINGHOUSE-REVIEWED 
PROGRAMS IN THE PILOT DISTRICTS 

The database identifies whether a program or 
policy has been reviewed by the What Works 
Clearinghouse. Two programs reviewed by the 
What Works Clearinghouse, Talent Search and 



Career Academies, had been implemented by at 
least one pilot district as of June 2007. None of 
the districts was using the other 10 programs 
reviewed by the What Works Clearinghouse as 
of June 2007, and none was using a What Works 
Clearinghouse-reviewed program that has mixed 
effects or no discernible effects. 

Talent Search is a program for middle school and 
high school students from low-income families 
who would be the first generation in their families 
to attend college. Students apply for the program 
and engage in activities to support career explo- 
ration and college application. Established more 
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than 30 years ago, Career Academies focuses on 
schoolwide, systemic change to lower dropout 
rates. High schools are organized as small learn- 
ing communities and incorporate academic and 
technical curricula around a career theme. Schools 
also establish partnerships with local employers to 
provide work-based learning. 

The What Works Clearinghouse found Career 
Academies to have potentially positive effects 
(evidence of a positive effect with no overriding 
contrary evidence) in helping students stay in 
school or progress in school. Talent Search was 
found to have a potentially positive effect on help- 
ing students complete school. Key informants, 
however, were not necessarily aware that the pro- 
grams received these ratings, perhaps because the 
reviews have only recently been released. Imple- 
menting districts typically had external, rather 
than district, funding to support implementation 
(noted in the database). 

Talent Search is implemented in five pilot districts. 
The number of students participating in the pro- 
gram varies, depending on the number of schools 
in the program. In Bridgeport about 800 students 
participate in the program across six schools, and 
the program targets both middle school and high 
school students. About 500 students participate in 
Lowell, 346 students in Providence, and 150 stu- 
dents in New Bedford and Springfield. In Spring- 
field the program is offered primarily to students 
in grades 11 and 12 in two schools. 



High School at Franklin High School in Rochester 
enrolls about 550 students in grades 7-12. 



Several programs and policies implemented by 
multiple districts have not been reviewed by the 
What Works Clearinghouse. These include Gear 
Up, Upward Bound, Positive Behavioral Inter- 
ventions and Supports, partnerships with local 
Job Corps, and credit recovery policies (in which 
students have the opportunity to catch up on defi- 
cient credits while continuing into the next grade 
with their same-age peers). Some districts are also 
implementing programs, including alternative 
schools, specifically for pregnant teens or focused 
on freshman students (freshman academies or 
freshman advisories, for example). To be eligible 
for a What Works Clearinghouse review, programs 
and policies must meet eligibility criteria, which 
demand substantial evaluation evidence. To date, 
such evidence is limited 
for most programs being 
used. Reflecting the lack 
of rigorous evaluation 
is that most informants 
could provide only an- 
ecdotal evidence of local 
success (not included in 
the database). 



Reflecting the lack of 
rigorous evaluation is 
that most informants 
could provide only 
anecdotal evidence 
of local success of 
programs or policies 



DOCUMENTING PROGRESS TOWARD 
EVIDENCE-BASED PRACTICES FOR 
KEEPING STUDENTS IN SCHOOL 



The Career Academies program is used in eight 
districts. As with Talent Search, student participa- 
tion varies, largely due to differences in implemen- 
tation scope. In Rochester two large high schools, 
Edison and Franklin, were subdivided into 
separate career-focused schools, each with its own 
principal. In Bridgeport students at Bassick High 
School are assigned to Achievement Academies in 
grade 9 and move into Career Academies in grades 
11 and 12, but students are not considered part of 
distinct schools as in Rochester. The smallest and 
newest Career Academy at Bassick includes about 
30 students, but the Bioscience and Health Career 



This report has limitations. One relates to the ac- 
curacy and completeness of the data, which were 
collected from a subset of key informants, begin- 
ning with top district officials and continuing 
with those identified by others as knowledgeable 
about local programs and policies. Interviews with 
other key informants might yield slightly differ- 
ent information. In addition, because most pilot 
districts did not have official district documenta- 
tion identifying which programs and policies 
constituted dropout prevention, some programs 
and policies in the database reflect key informants’ 
interpretations. Project data were drawn from 




16 



PILOTING A SEARCHABLE DATABASE OF DROPOUT PREVENTION PROGRAMS 



multiple sources, however, so the findings should 
be fairly accurate and complete. If information on 
a program or policy in publicly available docu- 
ments was inconsistent with information from an 
informant, researchers verified the accuracy of the 
public information with the informant or others as 
needed. 

A second limitation is that the information is 
static, reflecting programs and policies imple- 
mented (or recently implemented, if discontin- 
ued) during the data collection period (about six 
months). One objective of the project was to create 
a database that could be updated and maintained 
over time. The project gives a baseline for docu- 
menting and monitoring changes in the nine pilot 
districts. 



The database can 
become a living resource 
that documents and 
supports information- 
sharing by districts 
facing similar challenges 



The completion of the pilot 
phase with the first nine districts 
provides an opportunity to move 
forward with data collection in 
other districts. More districts can 
be added to the database— and 
the database can continue to be 
used to monitor progress toward 
evidence-based practices in the pilot districts. That 
expansion would create greater knowledge of what 
districts across the country are doing and could 
spark new collaboration and information-sharing 
among districts implementing similar programs 
and policies. This report makes three recommen- 
dations to better document progress, in the region 
and nationally, toward evidence-based practices 
for keeping students in school. 



• Move beyond the pilot phase with nine dis- 
tricts to collect data on dropout prevention 
programs and policies being implemented 
in districts across the country. This could be 
done through an effort across regional edu- 
cational laboratories and by a collaborating 



center such as the National Lab Network. 
Through that effort, regional educational 
laboratories could be invited, by the National 
Lab Network or another organization, to 
review and provide input on the protocol and 
database. This would ensure that the database 
elements and definitions are comprehensive 
and apply to districts, programs, and policies 
nationwide. New regional efforts can then be 
coordinated to collect similar data on samples 
of districts using the protocol and searchable 
database. The Northeast and Islands Region 
could work with the collaborating center to 
make the protocol and database available in 
other formats (online, for example). 

• Develop and implement a sampling plan to 
catalog dropout prevention programs and 
policies in Puerto Rico, where large propor- 
tions of students are at high risk of dropping 
out. 

• Expand the database to monitor changes in 
dropout prevention programs and policies 
and adoption of evidence-based practices 
in the initial pilot sites — and to include a 
greater diversity of districts within the region, 
especially larger cities where many students 
are at risk of dropping out. As part of this ex- 
pansion, the Northeast and Islands Regional 
Educational Laboratory and partner organiza- 
tions will need to develop a plan for sampling 
and data collection in larger districts such as 
Boston, Buffalo, and New York. The database 
can be revised and updated as new data are 
collected. 

These recommendations can make the database 
a living resource that documents and supports 
information-sharing by districts facing similar 
challenges, in the Northeast and Islands Region 
and nationwide. 
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NOTES 



The authors thank Carrie Golden and Gabe Gruner 
for their project assistance; Gail Agronick, Ph.D., 
and Shari Kessel Schneider, M.P.H., for their par- 
ticipation in interviews; and PowerWeb Results for 
database creation. 

1. According to the Connecticut State Depart- 
ment of Education web site, the cumulative 
dropout rate is a class rate that reflects the 
proportion of students within a high school 
class who dropped out of school across four 
consecutive years (Connecticut State Depart- 
ment of Education, 2007b). 

2 . On the Massachusetts Department of Educa- 
tion web site, low-income is defined as “an 
indication of whether a student meets any one 
of the following definitions of low income: 

1. The student is eligible for free or reduced 
price lunch; or 2. The student receives Tran- 
sitional Aid to Families benefits; or 3. The 
student is eligible for food stamps.” 



3. The annual dropout rate, according to the Mas- 
sachusetts Department of Education, “indicates 
the percentage of students in grades 9-12 who 
dropped out of school between July 1 and June 
30 prior to the listed year and who did not re- 
turn to school by the following October 1” (Mas- 
sachusetts Department of Education, 2007a). 

4. Functional requirements and the organiza- 
tional schema for the cataloging tool were cre- 
ated in consultation with PowerWeb Results. 
FileMaker Pro was selected for creating the 
database because of its versatility, ease of use, 
and availability. 

5. One district originally approached (Hartford, 
Connecticut) requested that, due to reorgani- 
zation, data collection be postponed until the 
2007/08 school year. This district was replaced 
by New Bedford, Massachusetts, which has a 
profile similar to that of the other sites. 

6. A confidentiality agreement prevents disclo- 
sure of the specific informant. 
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APPENDIX A 

METHODOLOGY FOR COLLECTING DATA 

AND CREATING THE DATABASE 

To inform and field test the protocol and search- 
able database, project staff worked with nine mid- 
size cities in the Northeast and Islands Region. 
Table A1 displays the demographic characteristics 
of the cities and their students. 

The project sought districts for which staff would 
be able to collect comprehensive information dur- 
ing the project period on programs and policies 
implemented within the whole district, rather 
than just in individual schools. Thus, the larg- 
est districts in the region (Boston, Buffalo, New 
York, and San Juan) were excluded for the initial 
field test. A list of mid-size cities in each state was 
compiled, with mid-size city defined by the Census 
Bureau of the U.S. Department of Commerce as a 
“central city of a metro area, with the city having a 
population under 250,000.” 

Statistics on each city’s non-White student popula- 
tion (Hispanic/Latino for ethnicity and African 
American, not Hispanic or Latino, for race), 
children living below the poverty line, and dropout 
rates were reviewed. The nine selected sites are mid- 
size urban districts with the highest percentage of 
non-White students, students living below the pov- 
erty line, and cumulative dropout rates. Methods 
of calculation for the cumulative four-year dropout 
rates and annual rates may vary across states. An- 
nual dropout rates reflect the percentage of students 
enrolled in a school year (often including the previ- 
ous summer) who did not return by the following 
October and who had not transferred to a different 
school. The four-year cumulative rate reflects the 
percentage of students in a specific cohort who were 
enrolled in 9th grade but did not graduate four 
years later. Each site had a non-White population 
of at least 23 percent, at least 21 percent of children 
living below the poverty line, and four-year dropout 
rates of at least 15 percent. 

Taken together, the selected school districts serve 
more than 200,000 students attending more than 



400 schools. Annual dropout rates range from 
about 4 percent to 9 percent; cumulative four-year 
dropout rates range from 15 percent to 34 per- 
cent. Three states (Maine, New Hampshire, and 
Vermont) and the Virgin Islands did not have mid- 
size cities that met study criteria (high dropout 
rates and minority student populations and many 
children living under the poverty line). As with the 
region’s largest districts, their programs and poli- 
cies can be cataloged in subsequent years using 
the protocol and searchable database. One district 
originally approached (Hartford, Connecticut) 
requested that, because it was undergoing reor- 
ganization, data collection be postponed until the 
2007/08 school year. This district was replaced by 
New Bedford, Massachusetts, which has a profile 
similar to those of the other sites. 



The protocol for systematic data collection 

A protocol was developed for compiling infor- 
mation from multiple sources about dropout 
prevention programs and policies. These sources 
included publicly available documents related 
to district and school initiatives, information on 
evidence-based programs identified by the What 
Works Clearinghouse and other dropout preven- 
tion resources, and interviews with key infor- 
mants at the district, school, and program levels. 
Supporting materials, such as introductory letters 
to school superintendents, interview guides, and 
templates for the initial recording of information, 
were developed (see appendixes B and C). The pro- 
tocol was then field tested in each of the selected 
districts and refined as needed. 

Collecting publicly available information on 
dropout prevention programs and policies. Follow- 
ing the protocol, staff conducted a comprehensive 
search of publicly available information on drop- 
out prevention programs and policies in the nine 
districts. This search provided preliminary, con- 
textual information on what districts were doing 
to address dropout. Taking this step reduced the 
burden on respondents and prepared interviewers 
to ask relevant questions that supplemented rather 
than duplicated publicly available information. 
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TABLE A1 

Demographic profiles of nine pilot districts 



City 


Total 

population 


Non-White 

(percent) 


5- to 17-year- 
olds living 
below the 
poverty 
line (percent) 


Total 

student 

population 


Cumulative 
four-year 
dropout rates 
(percent) 


K-12 

schools 


Race/ethnicity 
of students in 
the district 
(single category, 
rank order) 


Bridgeport, 

Connecticut 


139,529 


55.0 


21.8 


22,828 


22.0 


38 


Hispanic 

African American 

White 

Asian 


Lowell, 

Massachusetts 


105,167 


31.4 


21.8 


15,105 


16.6 


25 


White 

Asian 

Hispanic 

African American 


New Bedford, 
Massachusetts 


93,768 


46.3 


30.6 


13,106 


24.8 


27 


White 

Hispanic 

African American 
Asian 


New Haven, 
Connecticut 


123,626 


56.5 


31.0 


20,047 


16.6 


50 


African American 

Hispanic 

White 

Asian 


Providence, 
Rhode Island 


173,618 


45.5 


36.3 


27,900 


27.0 


54 


Hispanic 

African American 

White 

Asian 


Rochester, 
New York 


219,773 


51.7 


33.8 


34,598 


28.0 


62 


African American 

Hispanic 

White 

Asian 


Springfield, 

Massachusetts 


152,082 


44.0 


29.8 


26,132 


33.9 


48 


Hispanic 

African American 

White 

Asian 


Syracuse, 
New York 


147,306 


35.7 


29.5 


22,405 


25.0 


35 


African American 
White 
Hispanic 
Asian 


Worcester, 

Massachusetts 


172,000 


23.0 


21.7 


25,028 


15.5 


47 


White 

Hispanic 

African American 
Asian 



Note: Because cumulative, four-year dropout rates may be calculated differently across the sites and may be available for different school years, cross-district 
comparison is not recommended. 

Source: U.S. Census Bureau, 2006; Massachusetts Department of Education, 2007; Rhode island Department of Education, 2006; New York State Education 
Department, 2006; U.S. Department of Education, National Center for Education Statistics, 2007a, b; Connecticut State Department of Education, 2007b; 
Providence Public School District, 2007. 



The review included a search of web sites of school 
districts, state and local departments of education, 
community-based organizations in the school dis- 
tricts or working with the districts, state or local 



government agencies (such as police department 
and juvenile court systems), and local sources such 
as newspapers and television news stations. The 
information obtained included statements on the 
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local dropout prevention problem, students at risk, 
and district and school policies, programs, and 
budgets. In addition, staff attended regional meet- 
ings on dropout prevention and collected written 
materials. Information was used to tailor district- 
and program-specific questions for interviews 
with key informants. It was also coded, if relevant, 
for entry into the database. 

Collecting information from the What Works 
Clearinghouse review of dropout prevention 
programs. To assess whether districts are imple- 
menting evidence-based programs, project 
staff obtained information on the What Works 
Clearinghouse review of dropout prevention pro- 
grams by contacting colleagues at the What Works 
Clearinghouse and frequently checking the What 
Works Clearinghouse web site for updates (http:// 
www.whatworks.ed.gov). As of August 2007, 
reviews of 10 programs had been completed. Of 
these, five were rated as having potentially positive 
or positive effects on students staying in school 
(Achievement for Latinos through Academic Suc- 
cess [ALAS], Career Academies, Check and Con- 
nect, Financial Incentives for Teen Parents to Stay 
in School, and Twelve Together). In addition, four 
were found to have potentially positive effects on 
students progressing in school (including ALAS, 
Career Academies, Check and Connect, High 
School Redirection, and Talent Development High 
Schools), and one had a potentially positive effect 
on students completing school (Talent Search). 
Project staff drew from the What Works Clearing- 
house dropout prevention review protocol (avail- 
able on the web site) to develop specific database 
fields (for example, types of strategies or target 
populations). To refine database fields, project staff 
also consulted other reviews of dropout preven- 
tion, including strategies defined by the National 
Dropout Prevention Center. 

Collecting information from key informants. As 

specified in the protocol, project staff made initial 
contact with the selected districts through an in- 
troductory letter describing the project scope and 
purpose. The letter was mailed to superintendents 
and school board chairs. Staff followed up a week 



later by phone or email. One purpose of the initial 
outreach was to obtain approval for district par- 
ticipation in cataloging. Through staff contact with 
a key informant at the district level, staff obtained 
referrals to appropriate knowledgeable sources, 
such as assistant superintendents, truancy direc- 
tors, and dropout prevention specialists. Project 
staff then contacted these referrals by phone or 
email and sent them the introductory letter as 
well. Project staff also directly contacted indi- 
viduals who directed programs, found through 
publicly available information, which targeted 
subpopulations of students found to be at elevated 
risk for dropping out in the literature. 

Open-ended and semistructured interview guides 
were developed for key informants at differ- 
ent levels in a district, with different questions 
used for each group type and for each individual 
interview (see appendix C for a sample interview 
guide). These guides were then tailored through 
an iterative process for the district, program, 
expertise, and position of each key informant: 
information received during one call shaped the 
information needed and the questions asked 
during a subsequent call, resulting in interview 
guides that differed for each key informant. For 
example, 19 program directors were interviewed, 
but each director was asked specific questions 
about his or her program, so the questions dif- 
fered. Interview questions were designed to elicit 
information about programs and policies that have 
dropout prevention, dropout reduction, or school 
completion as a goal or that focus on populations 
of students that the dropout prevention literature 
indicates are at higher risk of dropping out (for 
example, pregnant teens, students who are old for 
their grade, students with emotional or behavioral 
challenges) (Dynarski & Gleason, 2002; Neils 
& Balfanz, 2006; Rumberger, 2001; Osher et al., 
2003). To define dropout, project staff referred 
to event dropout rate, as defined by the National 
Center for Education Statistics: “students who left 
school between the beginning of one school year 
and the beginning of the next without earning a 
high school diploma or its equivalent (for example, 
a GED)” (Laird et al., 2006). 
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The interview guides also took into account the 
different knowledge bases and perspectives of key 
informants. For example, superintendents and 
other district informants gave information on the 
variety of initiatives under way in their district 
and overviews of student needs and dropout pre- 
vention policies. Key district informants then pro- 
vided names and contact information, if possible, 
of other individuals who had more specific knowl- 
edge of the programs and policies (for example, 
school principals or program directors). Project 
staff followed up with these individuals, many of 
whom were able to provide additional information 
about programs for the database and details about 
implementation and perceived local challenges 
and successes. Interview questions were emailed 
to key informants several days before an interview 
so that they could prepare by checking with col- 
leagues or compiling requested information. 

Telephone interviews were designed to take 30-60 
minutes and were conducted by trained master’s- 
level staff with experience conducting research in 
education settings. Training and quality control 
were conducted by project leaders. With permis- 
sion, telephone calls were recorded to make a com- 
plete record available for coding. Detailed written 
notes were also taken during the interview and 
reviewed weekly. A communication log provided 
up-to-date information about data collection, 
including the name of the person interviewed, the 
interviewer, the date, and the time. This reposi- 
tory facilitated entering program information into 
the database. As interviews were completed, staff 
members conducted further Internet research on 
the programs as needed. Key informants were 
asked to send additional written materials that 
they believed would be helpful to the project. All 
project data, including written notes, audio cas- 
settes, and supplemental materials, were stored at 
Education Development Center, Inc. 



Sample of key informants 

A total of 58 representatives across the nine dis- 
tricts participated in project interviews. Infor- 
mants held key positions at the district, school, 



and program levels. The average number of key 
informants per district was six. In all but one 
district, at least four individuals participated in in- 
terviews. Variability in informants per district in 
part reflects the knowledge base of those initially 
interviewed and the availability of public docu- 
ments about dropout prevention programs and 
policies. The types of positions held by informants 
and the number interviewed in each position are 
in box 1 in the main report. 



Producing the interactive, searchable database 

Working with PowerWeb Results, the research 
team developed the functional requirements and 
the organizational schema for the database (see 
appendix D). FileMaker Pro was selected for the 
database because of its versatility, ease of use, and 
availability. The database is searchable by fields: 
target audiences, prevention strategies, age ranges, 
in-school and out-of-school staff involvement, and 
whether the program was reviewed by the What 
Works Clearinghouse. Information can be readily 
updated and new districts can be added. Pro- 
grams that are no longer being implemented can 
be stored, along with information about the dates 
when they were active. Over the long term the 
database can thus become a cumulative database 
of past and present dropout prevention programs 
and policies in this region or elsewhere. 

The searchable database is divided into four types 
of interlinked pages: 

• The program and policy details page can 
be used to find information about a specific 
dropout prevention program or policy imple- 
mented in a district. 

• The district details page can be used to view 
information about each district and includes 
demographic information, such as the share 
of students eligible for free or reduced-price 
lunch, the ethnic composition of the student 
body, and the most recent dropout rates. The 
district pages include links to programs or 
policies in the district. 
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• The school details page captures demographic 
and program information for each school in 
the database. The school pages include links to 
programs or policies in the school. 

• The prevention programs list is a sortable list 
that includes the name of each program or 
policy in the database and the corresponding 
districts. Users can sort by program name or 
district. A hyperlink will take them to the cor- 
responding program or policy details page. 



Program and policy details page 

The purpose of the program and policy details 
page is to provide users with a snapshot of each 
dropout prevention program or policy in the 
database. For each record the page includes fields 
on service goals, demographics of the target 
audiences, staffing, and whether the program was 
reviewed by the What Works Clearinghouse. 

Title. This field includes the formal or informal 
title or name of the program or policy, as provided 
by interviewees. 

Brief description. This field includes 1-3 sentences 
describing the program or policy and the target 
population. 

Core strategies. For each program, the database lists 
the core strategies that program uses to address 
or prevent dropout. A list of 15 dropout preven- 
tion strategies identified by the National Dropout 
Prevention Center (NDPC) on its web site was used 
as a starting point for creating the core strategies in 
the database (National Dropout Prevention Center, 
2007). After reviewing the 15 strategies, staff 
revised the list with input from expert advisors to 
ensure that the list includes specific strategies used 
by programs found to have positive or potentially 
positive effects by the What Works Clearinghouse 
review. In addition, some strategies from the NDPC 
list, such as “mentoring/tutoring,” were separated 
into distinct strategies (“mentoring” and “tutoring/ 
extra classes”). Strategies related to early interven- 
tion in NDPC list (for example, “early childhood 



education” and “early literacy development”) were 
omitted, reflecting the target grades of the pro- 
grams reviewed by the What Works Clearinghouse. 
The core strategies are included in the database 
with a brief definition. Programs may incorporate 
more than one strategy. (See table 1 in the main 
report for the core strategies.) But note that strate- 
gies that are part of programs found by the What 
Works Clearinghouse to have positive or potentially 
positive effects may not produce similar effects 
when used alone or bundled with different compo- 
nents. Many factors related to strategy implementa- 
tion affect outcomes. 

Of the 17 strategies included in the database are 12 
incorporated into programs identified by the What 
Works Clearinghouse (as of January 2008) as hav- 
ing positive or potentially positive effects. These 
12 strategies are advocating for student needs, 
career education and workforce readiness, case 
management/service coordination, community 
collaboration, engaging and supporting families, 
mentoring, monitoring attendance, out-of-school 
enrichment, providing social and emotional 
support during transitions, social and emotional 
learning curricula, transforming the school envi- 
ronment, and tutoring/extra classes. 

Intervention level. This field identifies whether 
a program or policy uses a universal, selected, 
or indicated approach to dropout prevention, 
using definitions from the Institute of Medicine 
(1994). Because some programs have multiple 
components, they may use more than one type of 
approach. A universal approach targets the entire 
student population. A selected approach targets 
subsets of the population considered at risk for 
dropout because of their membership in a par- 
ticular segment of the population. An indicated 
approach targets individuals who have exhibited 
behaviors that put them at high risk. 

Service goals. This field documents the specific ser- 
vice goals targeted by each program or policy as a 
means of helping students stay in school, progress 
in school, or complete school. These goals reflect 
those that have been identified by literature on 



APPENDIX A 



23 



dropout prevention as being associated with drop- 
out (Bridgeland et al., 2006; Dynarski & Gleason, 
2002; Neils & Balfanz, 2006; Rumberger, 2001). 
Most programs identified through the multiple 
data collection strategies— including those recog- 
nized by the What Works Clearinghouse review — 
target at least one of these service goals: 

• Improve academic performance. 

• Address behavioral challenges. 

• Provide career planning and preparation. 

• Promote college planning and linkages. 

• Provide mental health support. 

• Decrease truancy. 

• Address school safety and environment. 

• Increase school attachment. 

• Provide support during transitions. 

What Works Clearinghouse-reviewed program. For 

each database entry, users can identify whether 
or not the program is one reviewed by the What 
Works Clearinghouse. 

Staffing. This field provides information about the 
level of staffing, both in-school and out-of-school, 
needed to adequately implement the program or 
policy. In-school staffing could include teachers, 
administrators, counselors, and in-school pro- 
gram directors. Out-of-school staff could include 
program directors, nurses, agency staff, and com- 
munity volunteers (mentors, for example). 

Funding. This field identifies the funding sources 
for each program or policy. Possible funding 
sources include private organizations and dis- 
tricts, states, and the federal government. Infor- 
mation about the yearly cost to run the program or 
policy is included, if available and received. Cost 
information is often approximate and could vary 



greatly based on the scope of the program, the 
number of participants, and the available funding. 

Demographics of participants. The program details 
page also includes fields identifying the targeted 
participants of each program or policy, if any. 

These fields specify whether a program targets 
specific grade levels, the approximate breakdown of 
participants’ gender or ethnicity, and other specific 
population targets. Specific target populations in 
the database are those that literature has identified 
as historically being at risk for dropping out and 
include students with academic failure, English 
language learners, students who would be the first 
generation to attend college, students from low- 
income families, pregnant teens and teen mothers, 
students returning from incarceration, students 
with special needs (behavioral challenges, learning 
disabilities, and mental health needs), and students 
who are chronically truant or absent. 



District details page 

Like the program details page, the district details 
page provides a snapshot of each targeted district 
and its programs and policies to address dropout. 
In addition to the district name and a link to the 
district web site, demographic information about 
the student population is included. Demographic 
information includes the number of schools in the 
district, the student population, the city popula- 
tion, the proportion of students eligible for free or 
reduced-price lunch, and the ethnic breakdown of 
the student population. 

The page includes a list in alphabetical order of all 
the programs implemented by the district that are 
included in the database. By clicking on the program 
name, the user is taken to the program details page. 
The page also includes an alphabetized list of all the 
schools in the district implementing one or more 
programs in the database. By clicking on the school 
name, users are linked to the school details page. 

The page also includes data on the district dropout 
rate and the graduation rate, with the most current 
data available from state departments of education 
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or district web sites included (data are from Massa- 
chusetts Department of Education, 2007; New York 
State Department of Education, 2006; Connecticut 
State Department of Education, 2007; Rhode Island 
Department of Education, 2006). The school year 
of the data is noted. The database allows room for 
additional data to be entered into the database for 
subsequent years, so users can track dropout and 
graduation rates of each district. Information on 
how dropout rates for a district were calculated can 
be included should definitions of school dropout 
rates change over time. 



School details page 

The school details page allows users to see what 
dropout prevention programs and policies are 
being implemented at a particular school. Like 
the district details page, the school details page 
includes a list of dropout prevention programs or 
policies implemented at the school, with hyper- 
links to the corresponding program page and the 
district page. The database includes only those 
schools implementing one or more programs in 
the database. 
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APPENDIX B 

SAMPLE INTRODUCTORY LETTER 

November 27, 2006 
[ADDRESS] 

Dear [Superintendents/School Board Chair]: 

The Northeast and Islands Regional Educational Lab (NEIREL), funded by the U.S. Department of Education, is 
creating a database of current dropout prevention policies and programs that target urban minority students in 
our region. This database is being created to: 

• Support collaboration across districts around promising strategies to address dropout prevention; 

• Identify dropout prevention programs and strategies that school districts believe are effective in targeting and 
addressing dropout for specific student populations; 

• Document local efforts to use evidence-based programs and strategies, such as those identified by the What 
Works Clearinghouse (WWC); and 

• Highlight success stories across the Northeast and Islands Region on overcoming potential barriers to the 
implementation of prevention strategies that may reduce dropout rates. 

We will begin collecting information this year on nine public school systems in our region. The [city] school 
district was chosen as one of the initial districts because of its size (mid-size city) and the diversity of its student 
population. We’d like to learn from you, as a part of this first group, about the best way to collect information and 
make it useful for you and other districts in the region. 

Recognizing the demands on your time, we have started to collect publicly available information on dropout pro- 
grams in your district. We would, however, like to supplement and update this information with brief interviews 
with knowledgeable school officials. We would like to schedule the first interviews to take place in December 2006 
and January 2007, and anticipate they will last between 30 and 60 minutes. We will send out questions in advance 
so those being interviewed are familiar with the topics to be covered. Information collected will be at the district 
level; we will not collect any personal information. 

We will follow-up this letter to answer any questions you may have about the cataloging project and process and to 
schedule a time that you may be available to participate in an interview. Thank you in advance for your time and 



consideration. 



Sincerely, 



Athi Myint-U, Ed.M. 
Study Leader 



Lydia O’Donnell, Ed.D. 
Study Leader 
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APPENDIX C 

INTERVIEW INSTRUCTIONS AND 
SAMPLE QUESTIONS 



Interviewer instructions 

1. Introduce the purpose of the phone interview: 

Thank you for agreeing to speak with me 
today about the kinds of dropout prevention 
policies and programs that are being initi- 
ated in the [name of school district] school 
district. The purpose of this project is to 
collect information on how schools in the 
Northeast and Islands Region of the United 
States are address the challenge of dropout 
prevention 

Before we start, do you have any questions I 
might answer? 

2. Ask for permission to record the interview for 
note-taking purposes. State that the infor- 
mation will be used at the district level with 
no personal information collected. The data 
will be used for writing final reports and for 
establishing a database with information on 
what schools in the Northeast are doing to 
reduce dropout rates. State that the interview 
will not take up more than 60 minutes of 
their time. 

3. Conduct interview — referring to interview 
questions developed for each interviewee. For 
each program mentioned, try to get compre- 
hensive information to enter into the project 
data file. 

4. Request written materials (by mail, fax, or 
email) that may be available on those dropout 
prevention programs and policies mentioned 
and that can help get information for the 
database. 

5. Request contact information for other key 
individuals that it may be useful to contact/ 
interview for this project. 



Sample interview questions: superintendents 

1. Can you tell me about [districts policy 
regarding dropout prevention (middle, junior, 
or high school)? How is dropout prevention 
defined? Are there specific predictors (e.g., 
early warning signs) of dropout that [district] 
considers in its approach (e.g., how does 
district define students who are “at risk” for 
dropping out?)? 

2. What can you tell me about [district’s drop- 
out rate (what is the information source/year 
for this)? Has [district] set any goals regarding 
reduction in dropout rates? 

3. How does your school district identify stu- 
dents that are “at risk” for dropping out? 

4. What are the current dropout prevention pro- 
grams (by name) or strategies that are being 
implemented in [district]? (e.g., who it targets, 
primary outcomes, core strategy, reason for 
selection, dates implemented, cost, if known)? 

5. Can you tell me about [district’s “success sto- 
ries”? That is, a program or strategy that you 
think would be useful for other districts to 
learn about? Why do you think it worked well? 

6. Over the last five years, have there been any 
programs that you launched and liked but 
haven’t been able to continue? If so, why 
weren’t you able to continue them? 

7. The What Works Clearinghouse is currently 
issuing new reports based on their review of 
programs that seek to reduce dropout rates. 
Are you aware of the WWC? Are you famil- 
iar with any of the programs that have been 
found to have positive effects on dropout? 

• If you are familiar with any of the pro- 

grams, what would it take for the [dis- 
trict] school district to implement the 
programs found effective by WWC in 
your schools? (e.g., knowledge of effective 
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programs, financial resources, staff 
resources, administrative support, and 
buy-in)? 

• Have you considered implementing any 
other programs in [district] that use 
similar strategies to those reviewed by 
WWC? I can provide a brief description of 
the core strategy they use. 

• What do you see as barriers to getting 
these programs, or such programs, run- 
ning and sustained in [district]? What 
might it take to get them funded and ap- 
proved in [district]? Do you envision any 
barriers to sustaining them in [district] 
schools once implementation has started? 

Thank you for your time! 



Sample interview questions: key informant 
for Syracuse Choice, Syracuse, NY 

• What are the overall goal(s) of Syracuse Choice? 

• How does Syracuse Choice address dropout in 
Syracuse? 

• How many students are currently enrolled in 
Syracuse Choice? When did the program first 
start and how has enrollment changed since 
then (e.g., has enrollment grown?)? 



• Can you tell me about the demographic 
characteristics of the students who attend 
the Syracuse Choice (grades, ethnicity, other 
specific population, e.g., English language 
learners, special needs)? 

• How is it determined who attends the Syra- 
cuse Choice? Is it open only to students in the 
Syracuse School District? How many students 
would be eligible to enroll in Syracuse Choice, 
based on need (if space and resources were 
not an issue)? 

• What are the different strategies that Syracuse 
Choice uses in trying to reach its goals? Does 
it have an overall philosophy or approach? 

• Can you share some “success stories” about 
Syracuse Choice? How do you know if it’s 
working well (e.g., what percentage of students 
graduate, go on to college?)? 

• How many staff members are involved in 
Syracuse Choice? 

• What is the overall yearly cost to run Syracuse 
Choice? 

• What have been some of the major challenges 
of running Syracuse Choice? 



Thank you for your time! 
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APPENDIX D 

FUNCTIONAL REQUIREMENTS TABLE FOR DATABASE 

This functional requirements database was used 
to inform the coding and development of the final 
FileMaker Pro searchable database. It includes 
the various searchable fields to be included in the 
final database and information about how the 
data are coded and presented in the database (by 
drop down fields or check boxes, for example). 
Some fields have pre-coded values, and others have 
values entered in by the database administrator 



and specific to that particular program, school, 
or district. Shown in table D1 is the main screen. 
Links to adding districts and schools are available 
from this tab. One program record will have only 
one district. 

Table D2 is where demographic and contact infor- 
mation about the school districts in the study is 
entered. It contains the ability to add schools. 

Table D3 is for adding information about schools 
contained within a district. 



TABLE D1 

Prevention program information 



1 Field 


Type 


Functional type Values 


Comments 


Rules 


District name 


Alpha 


Entry box 






Program name or 
core strategy 


Alpha 


Entry box 







Type of strategy 



Intervention stage 



Program reviewed 
by WWC? 



Alpha 



Alpha 



Checkbox: • Accelerated credit accumulation 

multiselect • Advocating for student needs 

• Career education and 
workforce readiness 

• Case management/ 
service coordination 

• Community collaboration 

• Engaging and supporting families 

• Individualize or culturally/ 
linguistically relevant instruction 

• Instructional technologies 

• Mentoring 

• Monitoring attendance 

• Out-of-school enrichment 

• Professional development 

• Providing social and emotional 
support during transitions 

• Social and emotional 
learning curricula 

• Systemic/policy renewal 

• Transforming the school 
environment 

• Tutoring/extra classes 

Dropdown • Universal 

• Selected 

• Indicated 

Radio button • No 

or check 



This drop 
down is 
changeable 
by database 
administrator. 



(CONTINUED) 
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TABLE D1 (CONTINUED) 

Prevention program information 



1 Field 


Type 


Functional type 


Values Comments Rules 


Service goals 


Alpha 


Check box: 


• Improve academic performance. 






multiselect 


• Address behavioral challenges. 






with ability to 


• Provide career planning 






add to the list 


and preparation. 

• Promote college planning 
and linkages. 

• Provide mental health support. 

• Decrease truancy. 

• Address school safety 
and environment. 








• Increase school attachment. 

• Provide support during 
transitions. 



Target grades 


Alpha 


Check box: 


• 6,7,8,9,10,11,12 


Check boxes 






multiselect 




to select the 










target grades. 


Number of participants 


Number 


Entry box 







In-school staff Alpha Checkbox: • Adjustment counselor Check all 

involvement multiselect • Behavioral resource office that apply. 

• Crisis counselor 

• Day care providers 

• Director 

• Dropout specialist 

• Grant writer 

• Guidance counselor 

• Nutrition counselor 

• Paraprofessional 

• Parent-community liaison 

• Principal/administrator 

• Psychologist/therapist 

• Resource officer 

• School nurse 

• School-wide 

• Security guard 

• Social worker 

• Special education staff 

• Support specialist 

• Student advocate 

• Teacher 

• Truancy/attendance officer 

• Tutor 

Out-of-school Alpha Checkbox: • Americorps Check all 

involvement multiselect • CBO that apply. 

• Corporate 

• DYS/DSS 

• Health clinic 

• Job Corps 

• Local higher education 

• Mental health services 

• Mentoring program 

• Parents 

• Police 

• Religious affiliates 

• Truancy court 

• Tutor 

• Other volunteer 

Gender of participants Alpha Checkbox: • Male 

multiselect • Female 
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TABLE D1 (CONTINUED) 

Prevention program information 



1 Field 


Type 


Functional type 


Values 


Comments 


Rules 


Ethnicity of partcipants 


Alpha 


Check box: 
multiselect 




African American 

Asian 

Latino 

Native American 
White 


Check all 
that apply. 




Specific target 
population (if 
applicable) 


Alpha 


Check box: 
multiselect 




Academic needs 

ELL 

1st generation college 
Low SES 

Pregnant teens/teen mother 
Re-entry 

Special needs (behavioral 
challenges, learning disabilities, 
mental health needs) 
Truant/absent 


Check all 
that apply. 




Funding sources 


Alpha 


Check box: 
multiselect 




District 

State 

Federal 

Private 


Check all 
that apply. 




Approximate cost to 
implement (per year) 


Number 


Entry box 










Start date 


Date 


Entry box 










End date 


Date 


Entry box 










Reason for 
discontinuation 


Alpha 


Entry box 










General notes 
about program 


Number 


Entry box large 
w/scrolling 










Schools running the 
program or policy 


Alpha 


Multiselect 
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TABLE D2 

District information 



1 Field 


Type 


Functional type 


Values 


Comments 


Rule 


School district city 


Alpha 


Entry box 


• Bridgeport 




Can only be 1 








• Lowell 




district record 








• New Bedford 




But multiple 








• New Haven 




districts can run 








• Providence 

• Rochester 

• Springfield 

• Syracuse 

• Worcester 




same program. 


School district 


Alpha 


Drop down 


• MA 


Will only show 




state 






• Rl 


appropriate 










• CT 


state based on 










• NY 


city selection 





Number of schools 


Number 


Entry box 


School district 
web site 


Alpha 


Entry box 


Student 

population 


Number 


Entry box 


City population 


Number 


Entry box 


% LEP 


Number 


Entry box 


%free or reduced- 
price lunch 


Number 


Entry box 



Student ethnicity Number 


Entry box 


• Asian 


Percentage 


Total must 


percent 




• Black 

• Latino 

• Native 




equal 100%. 






American 










• White 

• Multi-race 










or Other 







Dropout rate 
2003/04 


Number 


Entry box 




Percentage 


Dropout rate 
2004/05 


Number 


Entry box 




Percentage 


Dropout rate 
2005/06 


Number 


Entry box 




Percentage 


Dropout rate 
2006/07 


Number 


Entry box 




Percentage 


Dropout rate year 


Alpha 


Drop down 


• 2003/04 

• 2004/05 

• 2005/06 

• 2006/07 




Dropout rate by 
ethnicity 2003/04 


Number 




• Latino 

• Black 

• White 

• Asian 

• Native 
American 


Percentage 
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TABLE D2 (CONTINUED) 

District information 



1 Field 


Type 


Functional type 


Values 


Comments 


Rule 


Dropout rate by 
ethnicity 2004/05 


Number 




• Latino 

• Black 

• White 

• Asian 

• Native 
American 


Percentage 




Dropout rate by 
ethnicity 2005/06 


Number 




• Latino 

• Black 

• White 

• Asian 

• Native 
American 


Percentage 




Dropout rate by 
ethnicity 2006/07 


Number 




• Latino 

• Black 

• White 

• Asian 

• Native 
American 


Percentage 




Graduation 
rate year 


Alpha 


Drop down 


• 2003/04 

• 2004/05 

• 2005/06 

• 2006/07 






Graduation 
rate 2003/04 


Number 






Percentage 




Graduation 
rate 2004/05 


Number 






Percentage 




Graduation 
rate 2005/06 


Number 






Percentage 




Graduation 
rate 2006/07 


Number 






Percentage 




Notes 


Date created 


Date 










Date modified 


Date 










Created by 


Alpha 






System to assign 




Modified by 


Alpha 






System to assign 




Schools in 
database 


Alpha 


Entry box 






Click on name 
to be taken to 
that entry. 


District programs 
or policy 




Entry box 






Click on name 
to be taken to 
that entry. 
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TABLE D3 

School information 



Field 


Type 


Functional type 


Values Comments 


Rule 


School name 


Entry box 








School type 


Alpha 


Drop down 


• High school 

• Middle school 

• Elementary school 

• High school — magnet 

• High school — charter 

• Middle school — magnet 

• Middle school — charter 

• Alternative 




School city 


Alpha 


Entry box 


• Bridgeport 

• Lowell 

• New Bedford 

• New Haven 

• Providence 

• Rochester 

• Springfield 

• Syracuse 

• Worcester 


District record 


Programs or 
policies at the 
school 


Alpha 


Entry box 
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